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Abstract 

In this paper, we study the problem of transient signal analysis. A signal-dependent algorithm is proposed which sequentially 
identifies the countable sets of decay rates and expansion coefficients present in a given signal. We qualitatively compare our method 
to existing techniques such as orthogonal exponential transforms generated from orthogonal polynomial classes. The presented 
algorithm has immediate utility to signal processing applications wherein the decay rates and expansion coefficients associated 
with a transient signal convey information. We also provide a functional interpretation of our parameter extraction method via 
signal approximation using monomials over the unit interval from the perspective of biorthogonal constraint satisfaction. 
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I. Introduction 

Transient signal decomposition is a widely studied classical problem in signal processing. It concerns decomposing transient 
signals in terms of a countable set of decaying exponential signals. Analytically, this problem is trivially solved by the inverse 
Laplace transform. To observe this, consider a transient signal, x : [0, oo) —^ R, defined by: 

Vf > 0, x(t) = ^ (1) 

n^N 


where {A„ S (0, oo) : n S N} is the set of decay rates of x, {an G R.: n S N} is the set of corresponding expansion coefficients 
of X, and N = {1, 2, 3, ... } denotes the set of natural numbers. The equality in ([T]i holds in the sense of pointwise convergence 
of functions. Hence, we may recast it more formally as: 

k 

Vf > 0, x{t) = lim ane~^^*. (2) 

k—>oo 

n—1 

In the ensuing discussion, all equalities involving infinite summations of functions will refer to pointwise convergence as 
illustrated in (|2|l. 

The (unilateral or one-sided) Laplace transform is a ubiquitous tool in applied mathematics and engineering. In systems 
theory, it is particularly useful in solving various differential equations with known initial conditions. We briefly introduce 
the Laplace transform, and refer readers to m for a rigorous and complete development of the subject. In addition, the 
pertinent measure and integration theory used in our discourse can be found in ||2l. Eor a Borel measurable function / : 
([0, oo), B ([0, oo))) —(R, B (R)), where B {X) denotes the Borel u-algebra on a topological space X, the Laplace transform 
of /, denoted F : dom {F) C, is defined as: 


VsGdom(F), F (s) = ( 

J [0, oo) 


f(t)e 


(3) 






where fi denotes the Lebesgue measure and the integral is the Lebesgue integral. The domain of F, which is also known as 
the region of convergence (ROC) of the Laplace transform, is given by: 

dom(F) = < s G C : f |/(f)e“®‘| dfi{t) < oo 

[ J[0. oo) 

which is the set of all s G C such that /(f)e“®‘ is Lebesgue integrable and the Laplace integral in Q is finite. Observe that Q 
can be construed as a decomposition of F in terms of a “basis” of decaying exponential functions of s, f G (0, oo)} 

(where we do not claim that : f G (0, oo)} is a Hamel basis in the linear algebraic sense or a Schauder basis in the 

Banach space sense El). With this interpretation, the action of the corresponding “biorthogonal basis” is given by the inverse 
Laplace transform. In other words, the inverse Laplace transform produces the expansion coefficients of F corresponding to 
different decaying exponential “basis” functions. Guided by this intuition, we can construct: 

Vs G C, F, (s) = ^ (4) 

riGN 

corresponding to the transient signal x in O- The inverse Laplace transform of Fc : C —C can be verified to be the 
generalized function (distribution or signed measure): 

fx (t) = ^ an6 (t - A„) (5) 

riGN 

where 6 (•) denotes the Dirac delta function. For example, in the case where Vn G N, an > 0, we can prove (|5]l by first 
letting s = iuj, i = ^^—1, a; G K, to get a Fourier transform Fr {iui), and then exploiting convergence results of inverse Fourier 
transforms (characteristic functions), such as Levy’s continuity theorem to deduce the weak convergence of the finite 
measures corresponding to the partial summations of (|5]l. By inspecting (|5]l, we can read off the decay rates and expansion 
coefficients of the transient signal x. Moreover, under appropriate regularity conditions, the uniqueness of the inverse Laplace 
transform ensures that transient signals have unique sets of decay rates and expansion coefficients. 

Unfortunately, the inverse Laplace transform is numerically infeasible to compute, although it elegantly identifies the decay 
rates and expansion coefficients of transient signals. As a result, given a transient signal x in O, we are interested in identifying 
its decay rates {A„ G (0, oo) : n G N} and then extracting the corresponding expansion coefficients {q!„ G K : n G N} in a 
computationally efficient manner. To this end, we first survey some well-known algorithms to solve this problem, and then 
present an alternative algorithm which overcomes some of the shortcomings faced by current methods. 

IT Previous Approaches 

We now briefly review some well-established alternative methods from the literature dealing with both discrete and continuous 
exponential signal models, respectively. 

A. Prony’s Method and Descendants 

Fitting a finite time series to a parametric model consisting of the sum of finitely many exponential terms underlies Prony’s 
original method and forms the basis of its descendants ISl- lIT^ . Indeed, such methods typically rely in some key way on 
the relationship between the chosen signal model and the homogeneous solution to a difference equation in order to identify 
the pertinent decay rates via the intermediary factoring of an associated characteristic polynomial. Prior knowledge that the 
roots of this polynomial are purely real is difficult to leverage for nonharmonic signal models. Moreover, even in a finite¬ 
dimensional discrete-time context, extracting the expansion coefficients for known decay rates requires solving an ill-conditioned 
Vandermonde system iflTll for which specialized algorithms only alleviate some numerical instabilities ifTSl . Methods of this 
class have been shown to be misaligned with maximum-likelihood estimates of exponential signal parameters in the presence 
of noise na. Pencil methods have reported improved robustness to noise due in part to a hybrid singular value decomposition 
and Prony-like approach iflTll . 

B. Orthogonal Exponential Transforms 

The approximation of arbitrary smooth functions over a finite interval using a real exponential power series is dissatisfying for 
primarily two reasons: the optimal approximation coefficients typically change with increasing model order, and the associated 
computations may require solving transcendental equations M- Alternatively, an orthogonal exponential transform constructed 
by translating an orthogonal polynomial class to the unit interval and performing a suitable change of variables is limited in 
that the set of possible decay rates {A„ G (0, oo) : n G N} is restricted to N. 


We now illustrate using Jacobi polynomials the construction of such an orthogonal exponential transform. The degree n > 0 
Jacobi polynomial, ^ : [0, 1] —^ R, with degrees of freedom a, 6 S R, is given by the Rodrigues formula |[T9l - ll22l : 




^1 — b /'I jn 


r{b)z^-^{i-zy 




( 6 ) 


T{b + n) dz^ 

and further satisfies the recurrence relations mi-cii: 

A r(“. b)i\ _ n{n + a) (a+i, b+i), . 

d/n [Z)- ^ (Z) 

where r( ) denotes the gamma function. Degenerations of Jacobi polynomials commonly arising in signal processing contexts 
include Chebyshev (a = & = — ^) and Legendre {a = b = 0) polynomials. The orthogonality of Jacobi polynomials on the 
closed unit interval, for {(a, 6) S R^: a > 0, a + 1 > &}, is readily verified by checking that; 

[ Jt ^\z)wiz)dz = yHr" W y in + a-b + 1) _ 

7(0,1] V t V ; (a + 2 n)r(a + n)r (6 + n) ^ ^ 

where A[-] is the Kronecker delta function, and w: [0, 1] —R is the scaled beta density weighting function w{z) = 


z^-^ (1 - z)' 


i — b 


In translating Jacobi polynomials into a transient setting, we proceed using a = b = 2 for simplicity (consistent with the 
presentations in and ||24l) and set z = e“*. Factoring and distributing the transformed weighting function into definition 
©, the nth orthogonal exponential basis element, J„ : [0, oo) —>■ R, n G N, is defined by: 


Vf > 0, J„(f) = (-1)"“^ (e-‘) . 


(7) 


These polynomials in e“‘ form an orthogonal basis under the inner product later defined in (fTTT l. With an orthogonal basis in 
place, obtaining the expansion coefficients {a„ S R : n S N} for a given transient signal a: is a standard exercise. We simply 
decompose x as: 


= Y. 


neN \7[0. 

and after some straightforward manipulations, we obtain: 


x{T)Jn{T)dT Jn{t) 


( 8 ) 


= E E 


n^N k—1 




x{t) J„{T)dT Cn, ke = 


neN 


(9) 


where c„, k is the coefficient of the term e in Jn(t). We conclude by remarking that selecting a = b = 2 was not a 
limitation; in ll2^ . an orthogonal exponential transform is designed with a = 4 and 6 = 3. 

III. Transient Signal Space and Its Properties 

We now formally set up the space of transient signals. We assume that there is a fixed but unknown set of decay rates, 
A C (0, oo), that is countable and well-ordered. The well-ordering property of A ensures that A is a totally ordered set in which 
every non-empty subset contains a well-dehned minimal element. This precludes sets akin to Q (the rational numbers). Moreover, 
the well-ordering endows the countable set A = {A„ G (0, oo) : n G N} with a natural enumeration; 0 < Ai < A 2 < • • ■, that 
we hx from hereon. This setup is more general than previous approaches. Indeed, the countable and well-ordering assumptions 
on A subsume the case of A C N, which is a necessary restriction made in the orthogonal polynomial approach in Subsection 

HUS 

The space of transient signals, V(A), is parametrized by A, and is defined as the set of all functions x : [0, 00 ) —R 
satisfying O, in a pointwise convergence sense, for some countable set of expansion coefficients {q;„ G R : n G N} that is 
absolutely summable; 

Y l“"l < o®- (10) 

nGN 

The absolute summability of the expansion coefficients ensures that the limit in (|2]) converges to a finite real number for every 
f > 0, and permits us to use any arbitrary order of summation over n G N in ([T]). We define L^ ([0, 00 )) as the separable 
Hilbert space of Borel measurable real functions on [0, 00 ) equipped with the standard ([0, 00 )) inner product; 


V/,gGL2([0,oo)), 

Jlc 


[ 0 , 00) 


f(t)g(t) dg.{t). 


( 11 ) 








The next theorem presents some properties of the transient signal space V(A), and relates V(A) to ([0, oo)). 

Theorem 1 (Properties of Transient Signal Space). The transient signal space, V(A), has the following properties: 

1) Every signal x G V(A) is Borel measurable and continuous. 

2) If each x G V(A) represents the associated equivalence class of functions in ([0, c»)) that are equal to x p-almost 
everywhere, then V(A) C ([0, oo)). 

3) V(A) is an inner product space equipped with the standard ([0, oo)) inner product. 

Proof: Fix any transient signal x G V(A) and let ([T]i be its expansion. Then, x is Borel measurable because it is the 
pointwise limit of continuous (and hence, Borel measurable) functions El. Moreover, observe that for any k gN: 


sup 

t>0 


k 

x{t) - 

n=l 


sup 

t>0 


m 


lim > Q!r,,e 

m—^co 

n—k-\-l 


— Xnt 


< sup V I 


— Xnt 


OO 

= 

n—k-\-l 


where the first equality follows ([T]), the second inequality follows from the continuity of f i—7> |t| and the triangle inequality, 
and the final equality holds because Vn G N, < 1 with equality if and only if f = 0. Hence, by letting k —?> oo, we 

see that ([T]i holds in a uniform convergence sense due to (fTOl l ll26l . Since the partial summations in (|2]i are continuous and 
converge uniformly to x, x must be continuous by the uniform convergence theorem ll26l . The continuity of x also implies it 
is Borel measurable. This proves the first property. Now consider: 


/ x^{t)dp{t)= f 

JlO.oo) “'[ 0 . 


p —(A„+Am)i 


dp,{f) 


n, mGN 


< 




< 


I g 2Ait ^ \a„\\am\dn{t) < OO 

Xo.co) n.mGN 


where the first equality follows from the Cauchy product corresponding to x^(f) after swapping the order of summations 
and changing dummy variables; these operations hold because the series in ([T]l absolutely converges for every f > 0 due to 
Coll, which implies that the Cauchy product absolutely converges for every f > 0 by Mertens’ theorem and Exercise 13 in 
Chapter 3 of ll26l . The second inequality follows from the triangle inequality, the continuity of f i—|f|, and the monotonicity 
of the Lebesgue integral, and the third inequality follows from the well-ordered enumeration of A. The third expression is 
finite because Ai > 0 and the expansion coefficients satisfy (fTol l. Hence, x G V(A) x G ([0, oo)), which means that 
V(A) C ([0, oo)), where each continuous signal in V(A) (using the first property) uniquely represents the corresponding 
equivalence class of functions in ([0, oo)) that are equal /r-almost everywhere. Note that such equivalence classes are the 
vectors of ([0, oo)) Q, and any such equivalence class contains at most one continuous function. By a uniqueness of inverse 
Laplace transform argument as delineated in Section|I] we can show that G ([0, oo)) \V(A) if A ^ A and A > 0. This 
implies that V(A) C if ([0, oo)) (proper subset), which proves the second property. 

We now prove the third property. Recall that C ([0, oo)), the set of real continuous functions on [0, oo), is a vector space 
over R with equality defined pointwise, and V(A) C C ([0, oo)) by the first property. To verify that V(A) is a linear 
subspace of C ([0, oo)), we must check that V(A) contains the additive identity function, and is closed under addition of 
functions and multiplication by real scalars lIZTl . The zero function (additive identity) is clearly in V(A). If x G V(A) with 
expansion coefficients {an G K : n G N} and y G V(A) with expansion coefficients [fn G K : n G N}, then for every a, b gM., 
{aan + bpn G K : n G N} is a valid set of expansion coefficients because it is absolutely summable by the triangle inequality. 
It is easily verified using ([U that ax + by has expansion coefficients {aa„ + 5/3„ G M : n G N}, and hence, ax + by G V (A) and 
V (A) is a vector space over K. By the second property, V (A) is a linear subspace of ([0, c»)), and inherits the standard 
([0, oo)) inner product with the nuance that V/ G V (A), (/, /) = 0 implies that / is the everywhere zero function. 
This subtlety arises because continuous functions in V (A) represent the corresponding equivalence classes of functions in 
([0, oo)). This proves the third property. ■ 

In Theorem [T] we are not concerned with whether V (A) is a closed linear subspace of ([0, oo)) with respect to the 
standard E^ ([0, oo))-norm (which would imply that V (A) is complete, and therefore, a sub-Hilbert space of E^ ([0, oo))). 






This is because equality in V (A) is defined pointwise, whereas equality in V (A) when embedded in ([0, oo)) is defined 
p-almost everywhere. The proof of correctness of our transient signal decomposition algorithm will rely critically on the 
pointwise convergence assumption. For this reason, we also do not pursue developing V (A) as the closed linear span of a 
Schauder basis of decaying exponential signals associated with A |0. We next illustrate some properties of transient signals 
that will naturally engender our algorithm as a corollary. 

Theorem 2 (Properties of Transient Signals). Every transient signal x G V (A) with expansion coefficients {a„ G R : n G N} 
satisfies: 

1) Vanishing Property: lim x{t) = 0 

t—¥CO 

2) Coefficient Isolation Property: lim e^^*x{t) = cti 

t—foo 

3) Laplace Principle: lim-log (|a:(f)|) = Ai 

t—foo t 

where log : (0, c») —>• R denotes the natural logarithm, and we assume without loss of generality that a.\ 0 for the third 

property. 

Proof: Observe from ([1]) that for every f > 0: 


|x(f)| 


nGN 


< ^ \an\e < e |a„| 

nGN rtGN 


where the first inequality follows from the triangle inequality and the continuity of f i—|f|, and the second inequality holds 
because A is well-ordered. Since the summation in the rightmost expression is finite due to (fTOl i. letting t ^ oo produces the 
first property. Next, using the same sequence of steps with the aforementioned justifications, we again observe from ([T]i that 
for every t > 0: 




n—2 


CO 

n^2 

oo 

< |a„| 

n—2 


from which we deduce the second property by letting t ^ oo. 

The third property is a variant of the Laplace principle from large deviations theory (Lemma 1.2.15 in l28]), which is 
useful in deriving upper bounds of large deviation principles. Informally, it states that the rate of decay of a sum of decaying 
exponential functions is dominated by the slowest rate. We now prove the third property. Once again, we observe from O 
that for every f > 0; 


ilog(|x(f)|) = -Ai + ylog 


E- 


«! + > anC 
n=2 


— (An— 


Furthermore, we have; 


lim log 

t—fco 


ai + 'y ^ a„e 






log(|ai|) 


using the continuity of f log(|f|), and the first property applied to the summation (which is a signal in 

V ({A„ — Ai : n G N\{1}}), where {A„ — Ai : n G N\{1}} forms a valid set of decay rates as A is well-ordered). Since 
log (Iail) is finite by the assumption that ai f 0, letting t ^ oo proves the third property. ■ 

In the next section, we use Theorem |2] to derive our algorithm for performing transient signal decomposition. 


IV. Computing Decay Rates and Expansion Coeeficients 

We now propose an iterative procedure through which we can recover the decay rates and expansion coefficients of any 
transient signal x G V(A). 


Transient Signal Decomposition Algorithm: 

Let Xk ■ [0, cxj) — R be the processed signal after the {k — l)th iteration of the algorithm, fc G N, so that xi = x. At the fcth 
iteration, perform the following steps: 

1) Compute 7 fe = lim -i log (|xfc(f)|). 

t—fco t 

2) Compute j3k = lim e^’’*Xk{t). 

t—^OO 










3) Set Xk+i(t) = Xk(t) — /3fee for every f > 0. 
Repeat forever. 


We note that termination at step if S N identifies the K — 1 most dominant rates in ([T]); if xk = 0, then x contained at most 
K — 1 non-zero terms. The next theorem asserts that A = {-jk : fc G N} and {(3k : fc G N} is the set of expansion coefficients 
of X. 

Theorem 3 (Correctness of Algorithm). For any transient signal x G V (A) with expansion coefficients {ak G M : fc G N} 
such that Vfc G N, ttfc ^ 0 without loss of generality, the transient signal decomposition algorithm produces the correct decay 
rates and expansion coefficients: Vfc G N, 7 ^ = Xk and (dk = o-k- 

Proof: The correctness of the transient signal decomposition algorithm follows inductively from the coefficient iso¬ 
lation property and Laplace principle in Theorem |2] In particular, they justify the computations performed on Xk G 
V (A\ {Ai, ..., Afe_i}), /c G N, at the fcth iteration of the algorithm, where we interpret {Ai, ..., Aq} as the empty set. 


We remark that an analogous algorithm can be designed for transient discrete-time signals and the rigorous development for 
the discrete case parallels the continuous case. 


A. A Functional Interpretation of Expansion Coefficient Extraction 

In the sequel, we focus on a particular method of expansion coefficient extraction for a given transient signal x of the form 
O, where A is assumed known from the outset. A rigorous treatment of this method is outside the scope of this paper; our 
intent here is to provide insight into decomposing x via the sequential application of appropriately defined linear functionals 
belonging to the dual space of V(A). To this end, we now state the integral operator property corresponding to mapping the 
so-called sifting property on the closed unit interval, [ 0 , 1 ], to the non-negative extended reals, [ 0 , 00 ]: 

f 6{z)x{z)dz = a;( 0 ) —>■ f e~*6 (e“‘) x{t)dt = x{oo) ( 12 ) 

J [0, 1 ] J [0, 00] 

where the right hand side of this expression additionally serves as our definition for continuity at infinity since [ 0 , 1 ] is 
homeomorphic to [ 0 , 00 ] with the translated topology. 

We next assert that the transient signal x is decomposable as: 


x{t) = ^ Rn{x)e 

nSN 


where the linear functionals, : V(A) —)► R, n G N, are: 


Rn {x) 



x{t) - 


n-1 ^ 

Rk{x)e~^'‘* 
k—1 / 


dt. 


(13) 


(14) 


We sketch a justification of this claim (and hence the claim that Vn G N, (a:)), by arguing that the linear functionals 

satisfy a set of conditions resembling biorthogonality: 

Vn, fcGN, i?„ = A[n-A:] = I J’ ■ (15) 

The possible scenarios of (fTSl) are summarized next using: 

e-^5{e-^) - 

00] \ 




1) For k < n: The expression inside the parentheses evaluates to the everywhere zero function (using induction), and hence 
the functional evaluates to zero by (fT^ . 

2) For k = n: The functional evaluates to unity since the summation inside the integral evaluates to the everywhere zero 
function (using induction) reducing the expression to: 



which follows from (fT^ and A„ = Afe. 



e *6 (e *) dt = 1 


(16) 



3) For k > n: The summation inside the integral evaluates to the everywhere zero function reducing the functional to: 

-^'=)*df = 0 (17) 


' [0, oo] 


(c-‘) 


which follows from (fT^ and A„ < Afe. 

Making this claim precise requires only standard analysis in order to invoke an appropriate representation theorem. It is 
immediate from the previous discussion that the algorithm proposed in this paper is effectively evaluating the biorthogonal 


linear functionals associated with {e 


\-rit . 


S N}, where A is additionally determined at runtime. 


B. Connections to Monomial Approximation and Taylor Series 

We now elucidate several relationships between a modification of Taylor approximation using monomials (sans the constant 
monomial) and our transient signal decomposition algorithm when A C N. In particular, consider a given function, /: [0, 1] — 
R, in the space defined by the span of the monomials {z": n G N}, written as: 


/(^) = 

nGN 

Analogous to Subsection IIV-AI we assert that / is decomposable as: 

neti 

where the linear functionals, : span {z": n G N} —>■ M, n G N, are: 

(- 1 )” I 


Qnif) = 


Tin) 


'[ 0 , 1 ] 


5(")(z)/(z)dz 


(18) 


(19) 


( 20 ) 


where denotes the nth distributional derivative of the Dirac delta function. A proof of this claim argues that the linear 

functionals in (l20l) also satisfy a set of conditions resembling biorthogonality: 

n = k 
n k 

The possible scenarios of (|2T]) are summarized next using: 

(- 1 )" 


Vn, fc G N, Q„(z'=) = A[n - k] ^ 


1 , 

0 , 


( 21 ) 


Qu{zn = 


r(n) 


'[ 0 , 1 ] 


5^'^\z)z'^dz. 


1) For k < n: The functional evaluates to zero since the monomial z^ is annihilated by the distributional derivative resulting 
in a sampling of the everywhere zero function by the sifting property in (fT^ on the left. 

2) For k = n: The functional evaluates to unity since taking n derivatives of the monomial z" yields an appropriately scaled 
constant valued function. 

3) For k > n: The functional evaluates to zero despite the fact that the distributional derivative does not annihilate the 
monomial z^, because the sampling occurs at z = 0 for which all non-constant monomials are zero valued. 

These scenarios coincide with the development in the previous subsection, and by extension, the behavior of the algorithm 
proposed in this paper. We conclude with the observation that these relationships are characterized by mapping ( l20b into (fT4l) 
by first recasting the linear functionals, {Qn : n G N}, as: 


Qnif) = [ <5(z)z-" [/(z) - Qfe(/)t 

■^[0. 1] V fe=l 


dz 


( 22 ) 


and then translating the domain [0, 1] to [0, oo] by substituting z = e“*. Indeed, the appropriate sampling of higher order 
monomials (k > n) parallels the limiting transient behavior of the exponential decay rate A„ — Xk while the annihilation or 
subtraction of lower order monomials is reminiscent of stage 3 in the proposed algorithm. 
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